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Abstract —In this paper, we investigate the global exponential 
stability for complex-valued recurrent neural networks with asyn¬ 
chronous time delays by decomposing complex-valued networks 
to real and imaginary parts and construct an equivalent real¬ 
valued system. The network model is described by a continuous¬ 
time equation. There are two main differences of this paper 
with previous works: (1), time delays can be asynchronous, i.e., 
delays between different nodes are different, which makes our 
model more general; (2), we prove the exponential convergence 
directly, while the existence and uniqueness of the equilibrium 
point is just a direct consequence of the exponential convergence. 
By using three generalized norms, we present some sufficient 
conditions for the uniqueness and global exponential stability 
of the equilibrium point for delayed complex-valued neural 
networks. These conditions in our results are less restrictive 
because of our consideration of the excitatory and inhibitory 
effects between neurons, so previous works of other researchers 
can be extended. Finally, some numerical simulations are given 
to demonstrate the correctness of our obtained results. 

Index Terms —Asynchronous, complex-valued, global exponen¬ 
tial stability, recurrent neural networks, time delays. 

I. Introduction 

Recurrently connected neural networks, including Hopfield 
neural networks |jT|, Cohen-Grossberg neural networks 0, and 
cellular neural networks {3|-0), have been extensively studied 
in past decades and found many applications in different 
areas, such as signal and image processing, pattern recognition, 
optimization problems, associative memories, and so on. Until 
now, many criteria about the stability of equilibrium are 
obtained in the literature, see 0-120) and references therein. 

It is natural to generalize the real-valued systems to 
complex-valued systems ED, which can be used in the 
nonlinear quantum systems, reaction-advection-diffusion sys¬ 
tems, heat equation, petri nets, chaotic systems, etc. Many 
approaches are also obtained, for example, decomposing 
complex-valued system to two real-valued systems is applied 
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in some nonlinear systems and regular networks, see 1221- 
li23i l and references therein. Recently, as an important part 
of nonlinear complex-valued systems, complex-valued neural 
network (CVNN) models are proposed as an important part of 
complex-valued systems, and have attracted more and more 
attention from various areas in science and technology, see 
E1-E3 and references therein. CVNN can be regarded as 
an extension of real-valued recurrent neural networks, which 
has complex-valued state, output, connection weight, and 
activation functions. For example, they are suited to deal 
with complex state composed of amplitude and phase. This 
is one of the core concepts in physical systems dealing with 
electromagnetic, light, ultrasonic, quantum waves, and so on. 
Moreover, many applications heavily depend on the dynamical 
behaviors of networks. Therefore, analysis of these dynamical 
behaviors is a necessary step toward practical design of these 
neural networks. In {35), a CVNN model on time scales 
is studied based on delta differential operator. In 1361 -1391 
discrete-time CVNNs are also discussed. Stability of complex¬ 
valued impulsive system is investigated by 00) . Until now, 
there have been various methods to study the stability of 
CVNNs, such as the Lyapunov functional method PT lI, the 
synthesis method {42), and so on. 

In particular, in hardware implementation, time delays 
inevitably occur due to the finite switching speed of the 
amplifiers and communication time. What’s more, to process 
moving images, one must introduce time delays in the sig¬ 
nals transmitted among the cells. Furthermore, time delay is 
frequently a source of oscillation and instability in neural 
networks. Therefore, neural networks with time delays have 
much more complicated dynamics due to the incorporation of 
delays, and the stability of delayed neural networks has be¬ 
come a hot topic of great theoretical and practical importance, 
and a great deal of significant results have been reported in 
the literature. For example, l43l investigates the stability and 
synchronization for discrete-time CVNNs with time-varying 
delays; 04) studies the stability of complex-valued impulsive 
system with delay. The global exponential and asymptotical 
stability of CVNNs with time-delays is studied by |45l with 
two assumptions of activation functions, while 06) and 071 
point out the mistakes in the proof of 03) and give some new 
conditions and criteria to ensure the existence, uniqueness, 
and globally asymptotical stability of the equilibrium point of 
CVNNs. 

In practice, the interconnections are generally asynchronous, 
that is to say, the inevitable time delays between different 



2 


nodes are generally different. For example, in order to model 
vehicular traffic flow ll48l - l|49l , the reaction delays of drivers 
should be considered, and for different drivers, the reaction 
delays are different depending on physical conditions, drivers’ 
cognitive and physiological states, etc. Moreover, in the load 
balancing problem (50), for a computing network consisting 
of n computers (also called nodes), except for the different 
communication delays, the task-transfer delays Tj k also should 
be considered, which depends on the number of tasks to be 
transferred from node k to node j. More related examples 
can be found in ED and references therein. Hence, based 
on above discussions, it is necessary to study the dynamical 
behavior of neural networks with asynchronous time (varying) 
delays. To our best knowledge, there have been few works to 
report the stability of CVNNs with asynchronous time delays, 
see ED, ED- For example, (52l focuses on the existence, 
uniqueness and global robust stability of equilibrium point 
for CVNNs with multiple time-delays and under parameter 
uncertainties with respect to two activation functions; while 
ED investigates the dynamical behaviors of CVNNs with 
mixed time delays. However, all these works (iD-sa, m, 
ED ) apply the homeomorphism mapping approach proposed 
by m to prove the existence, uniqueness and global stability 
of equilibrium point by two steps: step 1, prove the existence 
of equilibrium; step 2, prove its stability. In 0 and ED, 
a direct approach to analyze global and local stability of 
networks was first proposed. It was revealed that the finiteness 
of trajectory x(t) under some norms, i.e., f Q ||x(i)||df < oo, 
is a sufficient condition for the existence, and global stability 
of the equilibrium point. This idea was also used in (ID . In this 
paper, we will adopt this approach. Moreover, we give several 
criteria based on three generalized L a0 norm, Lj norm, L 2 
norm, respectively. In particular, based on Coo-norm, we can 
discuss the networks with time-varying delays. 

This paper is organized as follows. In Section|II] we give the 
model description, decompose the complex-valued differential 
equations to real part and imaginary part, and then recast it 
into an equivalent real-valued differential system, whose di¬ 
mension is double that of the original complex-valued system. 
Some definitions, lemmas and notations used in the paper are 
also given. In Section [HU we present some criteria for the 
uniqueness and global exponential stability of the equilibrium 
point for recurrent neural networks models with asynchronous 
time delays by using the generalized oo-norm, 1-norm, and 2- 
norm, respectively. Some comparisons with previous M-matrix 
results are also presented. In Section HVl some numerical sim¬ 
ulations under constant and time varying-delays are given to 
demonstrate the effectiveness of our obtained results. Finally, 
conclusion is given and some discussions about our future 
investigation of CVNNs are presented in Section [V] 

II. Preliminaries 

In this section, we give some definitions, lemmas and 
notations, which will be used throughout the paper. 

At first, let us give a definition of asynchronous time delays. 

Definition 1: (Synchronous and asynchronous time delays) 
For any node j in a coupled neural network, the synchronous 


time delay means that at time t, node j receives the informa¬ 
tion from other nodes at the same time t — Tj (t); while the 
asynchronous time delays mean that at time t, node j receives 
the information from other nodes at different times t — Tj k (t), 
i.e., for nodes k\ ^ /C 2 , Tj kl ( t ) and Tj k2 ( t ) can be different. 

Obviously, the network models of asynchronous time delays 
have a larger scope than that of synchronous time delays. 

In this paper, we will investigate the CVNN with asyn¬ 
chronous time delays as follows: 

zj(t) = —djZj(t) 

n n 

+ a jkfk(z k (t)) + ^2 b jk g k (z k (t - Tj k )) + Uj, 
k= 1 k =1 

j = !,••■ ,n (1) 

where Zj £ C is the state of j-th neuron, C is the set of 
complex numbers; dj > 0 represents the positive rate with 
which the j-th unit will reset its potential to the resting state in 
isolation when disconnected from the network; jj (■) : C —C 
and fjj(-) : C —> C are complex-valued activation functions; 
matrices A = (dj k ) and B = (bj k ) are complex-valued 
connection weight matrices without and with time delays; Tj k 
are asynchronous constant time delays; Uj £ C is the j-th 
external input. 

Remark 1: When Tj k = r, system (QJ becomes the model 
investigated in ED; when activation functions f t and gj are 
real functions, system 0 becomes the model investigated by 
ED- Therefore, this model has a larger scope than previous 
works, and all the obtained results in the next section can be 
applied to these special cases. 

For any complex number z, we use z R and z 1 to denote its 
real and imaginary part respectively, so z = z R + i ■ z 1 , where 
i denotes the imaginary unit, that is i = \J T. 

Now, we introduce some classes of activation functions. 

Definition 2: Assume fj(z) can be decomposed to its real 
and imaginary part as fj ( z) = f R (z R , z I )+ifj ( z R , z 1 ) where 
z = z R + iz 1 , '■ R 2 ^ R and fj (-, •) : R 2 —> R. Sup¬ 

pose the partial derivatives of jj(-,-) with respect to z R ,z I : 
dfj i /dz R ,dfj i /dz I ,dfj/dz R , and dfj/dz 1 exist. If these 
partial derivatives are continuous, positive and bounded, i.e., 
there exist positive constant numbers X RR , X RI , Xj R , Xj 1 , such 
that 

0 < df R /dz R < X RR , 0 < dff/dz 1 < X RI , 

0 < dfj/dz R < X IR , 0 < dfj/dz 1 < Af, (2) 

then fj(z) is said to belong to class Hi(X rr , X RI , Xj R , Xj 1 ). 

Remark 2: If f R and fj are absolutely continuous, then 
their partial derivatives exist almost everywhere. 

Definition 3: Assume gj(z) can be decomposed to its real 
and imaginary part as gj{z) = gj i (z R ,z I ) + igj(z R ,z I ), 
where z = z R + iz I , g R { -, •) : R 2 —> R and gj(-, •) : R 2 —> R. 
Suppose the partial derivatives of gj(-,-) with respect to 
z R ,z ! : dg R /dz R ,dg R /dz 1 ,dgj/dz R , and dgj/dz 1 exist. If 
these partial derivatives are continuous and bounded, i.e., there 
exist positive constant numbers g RR , g RI , Rj 1 , such that 

\dgf/dz R \ < g RR , Idgf/dz^ < g RI , 
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(3) 

ii\ 


\dgj/dz R \ < pt IR , Idg'/dz 1 ] < /if, 

then gj(z) is said to belong to class H 2 {g, RR , H RI , /if, /if). 

Remark 3: Definition [3] is the usual assumption for acti¬ 
vation functions in the literature of CVNNs, which can be 
found in US, G2), ED and references therein. However, the 
activation functions defined in Definition [2] is more restrictive, 
which will be useful when considering the signs of entries 
in connection weights, i.e., there is a trade-off between the 
assumption on activation functions and obtained final criteria. 

Therefore, by decomposing CVNN CD to real and imaginary 
parts, we can get two equivalent real-valued systems: 


zf{t) = —dj Z R (t) 

n 

+Y, a fkfk 


f R z R (t),zi(t) - 


1 


+ E b fk9k - T-jk),zl{t - T jk )^J 

- E b Wk (zk{t - Tj k )A{t - Tjkij + 




u R , 


(4) 


and 

4 (t) = ~djZj (t) 


E< 

k =1 
n 

E^ 

k =1 


a fk fk ( z k W 5 z k (t) ) + E a jkfk ( z k W> W 


fc=l 


bf k g k - T jk ), z{{t - Tjk)^ 

+ E h jk9k ( z k{t - Tjk),zi(t - Tjk)] + u]. (5) 

1 \ / 


Remark 4: The method of decomposing the CVNNs into 
two real-valued networks makes the network dimension grow 
two times, which may cause more calculations. However, 
this expansion of dimension can also bring some benefits. 
For example, the number (or dimension) of equilibria can be 
doubled, which enlarges the capacity of neural networks. It is 
a trade-off. 

The following three generalized norms are used throughout 
the paper. 

Definition 4: (See UOl ) For any vector v{t) £ R mxl , 

1) {£, oo}-norm. ||u(f)|| { j j0o} = maxj |£ i " 1 u / (f)|, where 

& > 0,3 = l,"' , m - 

2) {£, l}-norm. ||u(f)|| {c> i } = V , £jVj(t)\, where ^ > 
0,3 = !)••• ,™. 

3) {£, 2}-norm. ||u(f)|| {e , 2 } = {Ej £j\vj(t)\ 2 } 1/2 , where 

> 0,3 = !,••■ ,m. 

Lemma 1: (See Q0)) Let C = (c jk ) £ R mxm be a 
nonsingular matrix with Cj k < 0 ,j,k = 1 ,■■■ ,m,j ^ k. 
Then all the following statements are equivalent. 

1) C is an M-matrix, i.e., all the successive principal minors 
of C are equivalent. 

2) C T is an M-matrix, where C T is the transpose of C. 

3) The real part of all eigenvalues are positive. 

4) There exists a vector £ = (£i, ■ •• ,/ m ) T with all & > 
0,j = 1, ■ • • , to such that f T C > 0, or Cf > 0. 


Notation 1: For any real scalar a, denote a + = max{0,a}. 
For any matrix C = (cj k ) £ R nxn , denote \C\ = (\cj k \). 
In the following, we denote n x n matrices A R = ( a R k ), 
A 1 = (af), B r = (b R ), B 1 = (, bj k ), and 
F RR = diag{X RR , • • • , X RR }, F RI = diag{Af 7 , • • • , X RI }, 
F IR = diag{AC«, ••■,A«}, F 11 = diag{A{ 7 , • • ■ , Af }, 
G RR = diagjpf* • • • , g RR }, G RI = diagjpf', • • • , /*"}, 
G IR = diag{ M {* • • • , n„ R }, G 11 = diag{/*f, • • • , /if}. 

Notation 2: For any two non-negative functions f(t),g(t) : 
(—oo, +oo) -A [0, +oo), f{t) = 0(g(t)) means that for all 
t £ R, there is a positive constant scalar c such that /(f) < 
c • git). For any symmetric matric A, X ma x(A) means its 
largest eigenvalue. A n-dimensional vector p = (pi, • • • ,p n ) T 
is called a positive vector, if its all elements are positive, i.e.. 
Pi > 0,i = 1, • • • , n. 

III. Main Results 

In this section, we prove some criteria for the uniqueness 
and global exponential stability of the equilibrium. 


A. Criteria with {£, oo }-norm 

Theorem 1: For dynamical systems ([4} and if/}, 
suppose the activation function fjiz) belongs to class 
H\iX RR , X RI , Xj R , Xj 1 ) and gj(z) belongs to class 
H 2 in RR ,iJ RI ,fi I j R ,n I j I ), j = 1, ■■■,«. If there exists a 
positive vector £=(£].,■■■ , f n , fii, • • • , fi n ) T > 0 and e > 0, 
such that, for j = 1, • • • , n. 


^l(j) — £j ( - dj + e + {a R A + ■ X RR + ' 4 


E ^\a R \X RR + J2Maf k \X RI + ^ k \ a jk\X 

k=l,k^j k—1 k=l,kj^j 


IR 

k 




+ ^k^jkl^k 1 + f + y^^klbfkl^k 

k=l ^ k=l k=l 

n n \ 

+ E^I & jfcl4 fl + E^’ fe l4fel4 / )e erjfe < 0, (6) 


k =1 

and 


k =1 


— 4>j y - dj + e + {cijjy • A j + • A j 

n n n 

+ E £ fc l a ifcl4’ R + E Mafkl^k + E £fcl a tfcl^, 

1, k^j 


RR 

k 


k= 1 


k— 1 


k=l,h^j 


¥ 


k=1 


k =1 


/c=i fc=i ^ 

then dynamical systems Q and E have a unique equilibrium 
Z R = iz R , ■ ■ ■ ,z R ) T and Z 1 = (z[, ■ ■ ■ ,zi) T , respectively. 
Moreover, for any solution 

Zit) = (z R it), ■■■ , z R {t), z[{t), ■■■ , 4(t)) T , (8) 


there hold 


wmhcoo} = 0(e-*% 


(9) 
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II Z{t) - ( Z RT , Z /T ) T || {f>oo} = 0(e _£ *). (10) 

Its proof can be found in Appendix A. 

Corollary 1: For dynamical systems (0 and ([5]). 
suppose the activation function fj{z) belongs to class 
Hi( x f R , A|- J , Xj R , Xj * 1 ) and 9j{z) belongs to class 
H 2 (ljf R , V RI , H 1 /), j = 1, If there exists a 

positive vector £ = (£i,• • • , </>i, • • • , fa) T > 0, such that, 
for j = !,••• , n. 


+ J2^ k Kk\^k I +J2^\b I jk \fi RR + J2(/}k\b I jk \^k I < 0, 

fc=l fc=l fe=i 

(14) 

then any solution of systems © and © respectively converges 
to a unique equilibrium exponentially. 

This result is a direct consequence of Corollary Q] 

Remark 5: Theorem 1 can be generalized to the system 
with time-varying delays 


T3(j) = &( - d 3 + {a R }+ • X RR + {-4}+ • Af) 

n n n 

+ Y ^i a ffci A fc B +H^i°ffci A fc J + 5Z &i4i A fc fl 

k=l,k^j k—1 k—l,k^j 

n n n 

+ Y faWjk\ X k + Y tk\b? k \fJ.k R + Y fa\ b fkW RI 

k= 1 k =1 k—1 

n n 

+ ^&\b! k \vl R + Yfa\ b jk\t J 'l I < °> ( n ) 

fe= 1 fc=l 

r4(j) = h ( - d, + {a&}+ • Af + {/4} + • Af ) 


n n n 

+Y^ a fk\ x l R + Y ^Kki^k 1 +Y^ a U x k R 

k—1 k=l,k^j k= 1 

n n n 

+ Y ^k\aj k \X RI +Y^ b fk\l^k R + 

k=l,kjtj k—1 k =1 

n n 

+ J2^ bI ik\l 1 k R + Y^ b jk\l x k I <0, (12) 

k= 1 fe=l 


ij(f) = —djZj(t) 

n n 

+ Y a ikfk(zk(t)) + Y bjk9k{zk{t - T jk {t))) + Uj, 

fe=l fe=i 

i = 1, - - - ,n (15) 


where Tj k (t) can be bounded or unbounded. In fact, by The¬ 
orem 1, system © has an equilibrium Z = (z i, ■ • • , z n ) T , 
and 


d(zj(t) - Zj ) 
dt 


dj{Zj(t) - Zj) + Y a jk(fk(zk (i)) - /fc(zk)) 

fc=l 


n 

+ b jk{gk(z k {t - r jk (t))) - gk(zk))- 
k=1 


Replacing e £t i(i) by e et (z(t ) — Z) in the proof of Theorem 

1 and with the similar approach, we can prove that under the 

conditions © and ©, system (fi~5] i has a unique equilibrium, 

which is globally /j stable (for the concept of fi stability first 

proposed in ifTTl and details, readers can refer to fill . 1721 ). 


then any solution of systems © and © respectively converges 
to a unique equilibrium exponentially. 

If conditions (ITTI) and (ITT! hold, then we can find a sufficient 
small constant e > 0, such that inequalities © and © hold. 
Therefore, this corollary is a direct consequence of Thm. |7] 
Corollary 2: For dynamical systems 0 and ©, 
suppose the activation function fj{z) belongs to class 
Hi{X RR , x f T , X j R , X Y) and g 3 {z) belongs to class 
H 2 {r RR , g RI , Rj R , Rj 1 ), j = 1, • • • , n. If there exists a 
positive vector £ = (£i, • ■ ■ , £ n , fa, - ■ ■ ,fa) T > 0, such that, 
for j = l,-- - ,n, 

n n 

T5(j) = -Zjdj + Y Zk\a R k \X RR + Y MafA^k 1 

k=l k=1 

n n n 

+ Y^ k \ a U\ X k R + Y0 k \ aI ik\ X k + Ytk\ b ?k\Vk R 

k—1 k—1 k—1 

n n n 

+ Y/ ^klbfklRk 1 + £k\bjk\Rk R + Y* fiklbjklRk 1 < 0 > 

k=1 k =1 k=1 


T6(j) = -(j>jdj + Y tk\a R k \Xl R + Y fa\ a fk\ X k 

k=1 k=1 

n n n 

+ J2 & 1 1a Jk I ■ x k R + J2 4* I ' a j k I X k 1 + Y I b fk I vl R 

fc=1 fc=1 fe=1 


B. Criteria with {^, 1 }-norm 

Theorem 2: For dynamical systems © and ©, 
suppose the activation function fj(z) belongs to class 
Hi( xRR , xRI , X j R , x ] r ) and gj(z) belongs to class 
H 2 (R RR ,H RI ,Rj R ,R I j I ), j = If there exists a 

positive vector £ = (£t, • • • ,£„,</>i, • • • > ^>n) T > 0 and e > 0, 
such that, for k = 1, ■ ■ ■ , n, 


T7(k) =£ k (-d k + e) 

+ £fc a ' 


-i + 


2 kk 


Y tj\ a ?k\+Yh\ a 

j=l,jjtk j =1 


— £fc a fcfc + Yj £i\ a jk\ + 

J =1 


\ RR 

+ 


\IR 

A k 


+ Y. f £j(\bfk\Tk R + \bjk\Tk R ) 

j =i ^ 

+ <i>A\bfkWk R + I b I jk\t J ' RR ) S ) eeT:ik < 

T8(k) = 4>k(-d k + e) 


<t>ka R k+ Y fa^jkl+Y^rfkl 

j=t, j^k 0=1 


X k 


II 


fa a{ k + Y fa\ a jk\+Yto\ a fk I 

0=1,j^k 0=1 


-i + 


Af 7 


(13) 
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n / 

+ Y1 UidhfklVk 1 + HkWk 1 ) 

3 =1 A 

+ + Wjkl^k 1 )^ etTlk < 0; 

then dynamical systems © and © have a unique equilibrium 
Z R = (zf,-” ,Zn) T and Z 1 = (z[,--- ,z I n ) T respectively. 
Moreover, for any solution Z(t) defined by ©. equations © 
and (ITOt hold, while the norm is {£, l}-norm. 

Its proof can be found in Appendix B. 

Corollary 3: For dynamical systems © and ©. 
suppose the activation function fj(z) belongs to class 
Hi(X rr , X RI , Xj R , \y) and gj(z) belongs to class 
H 2 {p RR , p RI ,p IR ,pY), j = 1, ■ ■ ■ , n. If there exists a 
positive vector £ = (£i, • • • , £ n , </>i, • • • , f n ) T > 0, such that, 
for k = 1, • • • , n, 


T9(k) = -£ fc <4 


+ J2 & I a fk I + fa K 


+ 


jk I 




3=1 


K 


RR 


~ tjjWikl + F 1 


-1 + 


'j\ u jk I 


f=l 


f=l 


K R 


+yi a + iw*) 

j=i 

< 0 , 

TlO(fc) = 

n n -| + 


^\ a fk\+Yl ^Wjk\ 

j=l,jjik j=l 

n n 

<t>ka{ k + &\ a jk\ + Zj\ a jk\ 

j=l,jjik j=l 


xl 1 


i + 


Af 


+ y^Ajilbikl^k 1 + l^jklgV) + 4 , j(.\bfk\l J ’l I + \djk\l3-k 1 ) 

3 =1 

< 0 , 


then any solution of systems © and © respectively converges 
to a unique equilibrium exponentially. 

Corollary 4: For dynamical systems © and ©. 
suppose the activation function fj(z) belongs to class 
H 2 {X RR , X RI , Xj R , Xj 1 ) and 9j(z) belongs to class 
H 2 {p RR ,p RI ,p^ R ,py), j = 1, - - - , n. If there exists a 
positive vector £ = (£ 1 , • • • , £ n , </>i, ■ • • , f n ) T > 0, such that, 
for k = 1, • • • , n, 


Tll(fc) = -£ fc d fc + 


".A' ' zL°' " 


f=i 


i=i 


X RR 


<i ',k. • X !°> a 


yfel 


i=i 


i=i 


K R 


+ J2^(\ b fk\g RR + \ b jk\gl R ) + <t>o{\ b fk\A R + \ b jk\g RR ) 

3=1 

<0, (16) 


T12(k) = -4>kd k 


+ J2^\ a jk\ 

'- 3=1 3=1 






l 3k I 


Af 7 


+ 7 +1 b^jk I g fc 7 ) + $3 (\bfk\gV + \bjk\gk 1 ) 

3=1 

< 0, (17) 


then any solution of systems © and © respectively converges 
to a unique equilibrium exponentially. 


C. Some comparisons 

The following theorem is a direct consequence of Corollary 
0 Corollary Q] and the properties of the M-matrix. 

Theorem 3: For dynamical systems © and ©, 
suppose the activation function fj(z) belongs to class 
H 2 {X rr , X RI , Xj R , Xj 1 ) and gj{z) belongs to class 
H 2 lp RR ,p RI ,p IR ,pV), j = !,■■• ,n. Denote 


D = 
A = 
B = 


D 0 


0 D 

J ’ 




\A R \ 

|A 7 | 

1^1 N 
\A R \ y 

)- F =( 

' pRR 
pIR 

pRI 

F n 

\B r \ 

\B t \ 

\ 

} g rr 

G RI 

1 B J \ 

\B R \ . 

J ,G=\ 

d G IR 

G n 


(18) 


If D — AF — BG is a nonsingular M-matrix, then any solution 
of systems 0 and © respectively converges to a unique 
equilibrium exponentially. 

Proof: If D — AF — BG is a nonsingular M- 
matrix, according to Lemma [T] there exists vector £ = 
(Cl)--- ) £n) fi ) * * * An) T > o, such that ( D-AF-BG )£ > 
0, that is, inequalities (IT3l) and ( 1 1 41 ) hold. Therefore, the 
conclusion is a direct consequence of Corollary [2] 

On the other hand, if D — AF — BG is a nonsingular 
M-matrix, according to Lemma Q] there exists vector £ = 
Vhy-■ ■ VnAii-■ ■ An) T > 0, such that £ T (L> - AF - 
BG) > 0, that is, inequalities (fi~6] i and (ITTb hold. Therefore, 
the conclusion is also a direct consequence of Corollary |4] ■ 
Remark 6: Criterion based on M-matrix was also reported 
in l45l . However, it neglects the signs of entries in the 
connection matrices A and B, and thus, the difference between 
excitatory and inhibitory effects might be ignored. Compara¬ 
tively, the criteria given in Theorem [Q Theorem |2] Corollary 
U] Corollary [3] are more powerful. 

In the following, we give a comparison between Corollary 
[Hand Theorem [3 by using the matrix theory. Denote matrices 

p i = diag(|afi| - {an} + , • • • , \a R n \ - {a R n } + ); 

P 2 = diagdafH - {-<Xu} + ,''' , l«Ll - {-«L} + ); 

P 3 = diagdafH - {aV} + , ■■■ , |<4„l ~ {«L} + )- 


Obviously, these matrices are all non-negative definite. Define 


A = 


P 1 F rr + P 2 F ir 0 

0 P 1 F ii + P 3 F ri 


(19) 
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so it is also non-negative definite. Using this notation, and 
from Corollary [I] the sufficient condition for global stability 
is that 


D - AF - BG + A (20) 


should be a nonsingular M-matrix. Obviously, if D—AF—BG 
is a nonsingular M-matrix, the above matrix (l20l > is also a 
nonsingular M-matrix; instead, if matrix (l20l) is a nonsingular 
M-matrix, D — AF — BG may be not. 

Therefore, Corollary [j] presents a better criterion than that 
by previous works, like EE because it considers the signs 
of entries in the connection matrix A, whose positive effect 
is described by the above nonnegative matrix A defined in 
< n~9] >. Moreover, from this result, we can also find that in order 
to make the CVNNs have the stable equilibrium, Pi,P 2 ,P 3 
should be as large as possible, so one way is to make all 
a fj > j = 1; ‘ ‘ ‘ > n be negative numbers. 

Remark 7: The function M(t) = max t max^i,... \ui(t)\ 

proposed in IflOl is a powerful tool in dealing with delayed 
systems. In particular, for the time-varying delays. 

Remark 8: It can be seen that in computing the integral 
/ 0 °° | \Z(t)\ \dt, the estimation of ^||Z(f)|| plays an important 
role. 

Let A(t) = (a, 3 -)y =1 , £* > 0, i = 1, • ■ ■ ,N and 


dw . , . 

- = Aw(t) 

It has been shown that (see IE ED) 

d ;IH*)ll{Ci } 


max 


dt 


=max[a^-+^f- \a tj \} : 
ll^WllfCoo} r i V''Oi n 

maX II ( 4 -\ ii - - = max T Ki > 




max - 


Tt IK 


l«,2> 


( 21 ) 


= \ max (ZA + A T ^), 2 = diag(£). 


IU,2> 


dj ' “ 

i=1 j=l 

= EE sign(wi(t))j-a,ij]£jWj(t) 

j =1 i ^ 

j J 

< max[ajj + XEM]IK*)II{C1} 

3 s j 


Therefore, 


max 


IMOIIu.i} 


max [a 
j 


n 


+ E J-\ a ij\]- 

i*3 « 


Similarly, we can prove the other two equalities. 

These three equalities play very important role in dis¬ 
cussing stability of the neural networks or other dynami¬ 
cal systems. For example, if max, [a 3 j + | i l a ul] — 


-a < 0, then -^\\w(t)\\^ !} < —a||u;(f)||{£ !}, which implies 
IK*)ll { Ci} = 0(e-“‘). ’ 

It happens that these three equalities are closely relating to 
the matrix measure of A with respect to three norms. 


D. Criteria with {£, 2 }-norm 

Theorem 4: For dynamical systems © and ©, 
suppose the activation function fj(z) belongs to class 
Xf 1 ,\j R , \P) and gj{z) belongs to class 
Hi(r RR ,R RI ,R IR ,rY), j = 1, If there exists a 

positive vector £ = (£i, ■ ■ • , </>i, • • • , </>„) T > 0 and e > 0, 

such that, for j = 1, ■ • • , n, 

T13(j) = 2 £j(—dj + e + {af 3 } + \ RR + {— a jj} + ^j R ) 

n 

+ E tj(\ a ?k\ X k R + \a] k \>i R )^ l 3k 

k=l,k^j 

n 

+ E ^k(\a R j\X RR + \ a ij\Xj R )nl k j 
k—l,k^j 
n 

+ YMK\*F + Wjkl^k^^jk 

k =1 
n 

+ E ^{\ h fkWk R + 

k =1 
n 

+ JZ^jiKklTk 1 + IbjkWk^jk 

k =1 
n 

+ E M a kjWj R + \ a kj\Rf R )uikj 

k =1 
/ n 

+ (E&d^l^ + 1 6 £>f i ) 7r3 fc/ 

' fe=i 

n \ 

+ E+ \ b kM RR )^kf) e2tTki < °> 

k =1 ' 

= 2 (f>j(-dj + e + {a^} + Ff' R + Wjj} + ^f 1 ) 

n 

fc=i 

n 

+ E + l a jfelA t fc / ) w 2jfe 

n 

+ E ^ (1 1a kj I^f + I a fei I R RI ) u2 kj 

k=l,k^j 

n 

+ E ^'(1^1/4* + 

k =1 
n 

fc=l 

n 

+ J2Zk(\ a kj\ x ? 1 + i a fcjiE) 7r2 fc/ 

fc=i 

/ n 

+ ( + ) 7 r 4 fe/ 

^ fc=i 
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n \ 

+ E + \ b lj ) e2eTkj < °- 

fc=l ' 

where 7rl jfc , 7r2 jfc , 7r3 jfe , 7r4 jfe , wl jfc , w2 jfc , w3 jfc , w4 jfc are pos¬ 
itive numbers. Then dynamical systems © and © have a 
unique equilibrium Z and Z respectively. Moreover, for 
any solution Z(t) defined by ©, equations © and ( ITOl ) hold, 
where the norm is {£, 2}-norm. 

Its proof can be found in Appendix C. 

Corollary 5: For dynamical systems © and ©, 
suppose the activation function fj(z) belongs to class 
Hi(Xf R , Xf 1 , \j R , Xj 1 ) and Qj{z) belongs to class 
j = 1, • • • , n. If there exists a 
positive vector £ = (£i, • • ■ , £ n , </> 1; • • • ,(f> n ) T > 0, such that, 
for j = !,■■• ,n. 


T 15(j) = 

( d 

J + {a R } +xRR 

+ {-4i +A E 

+ 

E 

U\“fk\ x Z R + 

\ a jk\ X k R ) nl jk 


k=l ,ky£j 



+ 

E 

£k(.\a kj \\ RR + 

|c4l A fVifc/ 


k=l ,k^j 



+ 

E?j(i 

a fk\ XRI + 1 a jk\ 

A£ Z )7r2 jk 


fc=l 


n 

+ ' 52 tj(\ b ?k\vk R + \ b jM R )^jk 

k= 1 
n 

+ J2Zj(.Kk\Vk I + I b jkWk)^jk 

k= 1 
n 

+ E Ma R M] R + \ a kj\l l f R ) UJ ^kj 

k= 1 
n 

+ y^Ak(\bki\t 1 f R + 

fc=l 

n 

+ 51 + \ b kMf R ) uZ kj < °’ 

k= 1 

T16(j) = 2(f)j(—dj + {a R } + g RR + {«',} 7'"') 

n 

fc=l 

n 

+ 51 0j(l o jfcl/4 J + 

k=l,k^j 

n 

k=l,k^j 

n 

+E + i^fciMfc K )w 3 jfc 

fe=i 

n 

+ 51 + l^fclMfeO^fe 

fc=l 

n 

+ y^^fcd^lAf 7 + |a^|Aj / )7r2^ 1 

fe=i 


+ ^^fcd^l/xf 7 + l&jyl/^ 7 )7r4 fc / 

k=l 

n 

+E < o, 

k= 1 

where TTlj k ,Tr2 jk ,n3 jk , n4: jk ,u}lj k ,uj2 jk ,uj3jk 7 u}4 jk are pos¬ 
itive numbers. Then any solution of systems Q and © 
respectively converges to a unique equilibrium exponentially. 

Corollary 6: For dynamical systems 0 and ©, 
suppose the activation function fj{z) belongs to class 
H 2 {\ RR , A RI , \j R , Xj 1 ) and 9j{z) belongs to class 
H 2 (h rr , g RI , Hj R , n 1 /), j = l,--- ,n. If there exists a 
positive vector £ = (£i,•■■ ,£„,</>i, • • • , (j> n ) T > 0, such that, 
for j = !,••• ,n. 


T 17(j) = -2 Zjdj 

n 

+y^,£j(\ a ?k\^ RR 


fc=i 


RI 

k 


E^d4i A 

k =1 
n 

E &( 6 A >'k' 


k =1 


'7 


fc=i 

< 0 , 

T 18 (j) = — 2 (f)jdj 


- \ a jk\ X k R ) +J2^ a kj\ X f R + \ a kj\ X j R ) 

k—1 

n 

Wj k \ x k) +E&(i & ffci^ R +i^i^) 

fe=i 

n 

fc=l 

n 

- + E Mbkj^j 11 + \ b {jW RR ) 


k= 1 


E^-(i4i4 

fc=i 

n 

E^(i<>. 

fe=i 

n 


// 

j 


l 1 


k= 1 
n 

+ J2^k(\ b kj\l 1 . 

k= 1 
< 0 , 


i?7 

'7 


- K/j/O + E + i a ifei/ x fc / ) 

fc=i 

n 

- \a{j\9 RI ) + ^4>A\ b fkW R + l^fclMfc^) 

fc=l 

n 

l^fclFfc 7 ) + E^(l°fcfl A f J + l a fef l A f) 

/c=l 

n 

■ + E 


fe=i 


then any solution of systems © and © respectively converges 
to a unique equilibrium exponentially. 

Remark 9: As for how to use the norms || • ||{£,i} and || • 
11 {€, 2 } t° discuss the time-varying delayed networks, readers 
can refer to the papers [[15], 1 461 . 


IV. Numerical example 

In this section, some numerical simulations are presented to 
show the effectiveness of our obtained results. 

Consider a two-neuron complex-valued recurrent neural 
network described as follows: 

( zi(t) = -dzi{t ) + aufi{zi(t)) + ai 2 f 2 (z 2 (t)) 

I + b ngi{zi(t - 1)) + b 12 g 2 (z 2 (t - 2)) + m 

j z 2 (t) = —dz 2 {t) + <Z 2 i/i 0 i(f)) + a 22 f 2 (z 2 (t)) 

[ + b 2 igi{zi(t - 3)) + b 22 g 2 (z 2 (t - 4)) + u 2 

( 22 ) 


0.8 


-2-3/ 

3 -i 

4 — 2 i 

-1 + 2/ 

-1 + 2 i 

2 + z 

3 — 4 i 

—3 + 2 i 


where Zk = z R + izj., k = 1, 2, D = diag(d, d) = 19/2, and 
A = (djk) 2x2 = 

B = (bjk) 2x2 = 


fk(Zk) = 


= (ui,u 2 ) t = (-3 + /, 2 + 4/) 3 


1 - exp(-2^ - zj) 
l + exp(—2 zg-4) 

9k{Zk) = l + exp(-z*-2 z{) 


l + exp(-^-2 z{Y 
l-exp(-2 zg-zj) 

1 + exp(-2z* - z]A ' 


From simple calculations, we have, for j = 1,2, 


df] 

0 < J 


0 < 


dzf 

M 

dz R 


< 1 = 


< 0.25 = A 




df R 

0<^<0.5 = A f; 
0<||<0.5 = Af; 


therefore, fj(z) belongs to class f/i(l, 0.5,0.25,0.5), j = 
1,2. Similarly, we can prove that o,(z) belongs to class 
i/ 2 (0.25,0.5,l,0.5), j = 1,2. 

From the notations defined in (IT8l> . we have D = 19 / 4 , 




( 2 

3 

3 

1 



( 

1 

0 

0.5 

0 \ 

4 

1 

2 

2 


,F = 


0 

1 

0 

0.5 

3 

1 

2 

3 



0.25 

0 

0.5 

0 

1 2 

2 

4 

1 

) 


{ 

0 

0.25 

0 

0.5 j 

( 1 

2 

2 

1 

\ 


( 

0.25 

0 

0.5 

0 \ 

3 

3 

4 

2 


,G = 


0 

0.25 

0 

0.5 

2 

1 

1 

2 



1 

0 

0.5 

0 


2 

3 

3 

) 


\ 

0 

1 

0 

0.5 j 


# = 


Calculations show that eigenvalues of D — AF — BG 
are: -0.7655,18.6670,20.9701,19.8784, so it is not an M- 
matrix, which means that Theorem^is not satisfied. However, 
according to Corollary Q] and Remark [6j we have Pi = 
diag{2,1}, P 2 = diag{0, 2}, P 3 = diag{3,0}, and 


A = diagjPi + 0.25P 2 , 0.5 (Pi + P 3 )}, 


then eigenvalues of D — AF — BG + A are 
0.8488,20.0717,22.7947,21.5348, therefore Corollary Q] 
holds, so the above system can achieve its equilibrium 
exponentially. 

The following simulations present the correctness of our 
claim. We choose five cases for initial values. Case 1: 
z\(t) = — 4 + 3i,z 2 (t) = — 5 — i,t e [—4,0]; Case 2: 

Zi(t) = 2 + i,z 2 (t) = — 3 -F 2.5/,t £ [—4,0]; Case 3: 

Zi (t) = 3 — 5i,z 2 (t) = 6 + 3i,f e [—4,0]; Case 4: 

Zi (t) = —2 — 4i,z 2 (t) = —7 + 4 i,t £ [—4,0]; Case 5: 

Zi(t ) = 1+4 i,z 2 (t) = — 5— 1.5*,f £ [—4,0]. Figures [TJ4] de¬ 
pict the trajectories of z R (t), zf(t), z R (t), z|(f) respectively. 
For different initial values, they converge to the same equi¬ 
librium (—0.0351, 0.1423, 0.0912,0.2239) T , i.e., the unique 
equilibrium has the global exponential stability property. 

Moreover, if we choose the initial values as Case 1, and 
only the external control u are different, i.e., different external 
controls {ui,u 2 ) t = (—3 + *,2 + 4i) T and ( u'i,u' 2 ) t = (3 + 



Fig. 1. Trajectories of 2 ^(t) for different initial values, which show the 
global exponential stability of equilibrium 



Fig. 2. Trajectories of z^{t) for different initial values, which show the 
global exponential stability of equilibrium 



Fig. 3. Trajectories of t) for different initial values, which show the 
global exponential stability of equilibrium 
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Fig. 4. Trajectories of z 2 (t) for different initial values, which show the 
global exponential stability of equilibrium 



Fig. 5. Trajectories of all z^ (t) and z£(t),i = 1,2 under different 
external controllers (ui,U 2 ) and ( uu' 2 ), which means that the equilibrium 
is impacted by external control 

2i,4 — i) T are added on the CVNNs, figure 0 shows that the 
equilibriums are different, therefore, the equilibrium is heavily 
impacted by the external control. 

In the final simulation, we will consider the time-varying 
delays, thus we choose the equation as 

Zi (t) = —dzi(t) + anfi{zi(t)) + a 12 f 2 {z 2 {t)) 
+hi9i(zi(t - 1 - sin(f))) 

+b 12 g 2 {z 2 {t - 2 - cos(f))) + mi 
z 2 (f) = -dz 2 (t) + a 2 i fi{zi{t)) + a 2 2 f 2 {z 2 (*)) 
+b 2 igi{z 1 (t - 3 + sin(f))) 

+62232 (Z 2 (t - 4 + cos(f))) + u 2 

All the parameters, including the external control. 



Fig. 6. Trajectories of z, (t) for different initial values, which show the 
global exponential stability of equilibrium 



Fig. 7. Trajectories of z{(t) for different initial values, which show the 
global exponential stability of equilibrium 

are the same as defined in the above simulations. 
Similarly, according to Corollary Q] Remark 0 and 
Remark [6] this system can achieve its equilibrium 
exponentially. Figures [6J9] depict the trajectories of 
zf(t), z[ (t), zKf) respectively. Moreover, the 

equilibrium is also (-0.0351,0.1423,0.0912,0.2239) T , 
i.e., the equilibriums are the same for system (l22l i and system 
(l23l > even though they have different time delays. 

V. Conclusion and discussions 

In this paper, we first propose a complex-valued recurrent 
neural network model with asynchronous time delays. This 
feature is the first difference of this paper with previous works. 
Then under the assumptions of activation functions, we prove 
the exponential convergence directly by using the oc-norm, 
1 -norm and 2-norm respectively, the existence and uniqueness 
of the equilibrium point is a direct consequence of the ex¬ 
ponential convergence; while previous works in the literature 
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Fig. 8. Trajectories of z^ft) for different initial values, which show the 
global exponential stability of equilibrium 



Fig. 9. Trajectories of z 2 (i) for different initial values, which show the 
global exponential stability of equilibrium 


always use two proving steps: step 1, prove the existence of 
equilibrium; step 2, prove the stability. This is also a novelty 
of this paper for investigating the equilibrium of CVNNs. 
Moreover, considering the signs of coupling matrix, some 
sufficient conditions for the uniqueness and global exponential 
stability of the equilibrium point are presented, which are more 
general and less restrictive than previous works, i.e., the M- 
matrix property of D — AF — BG is just a special case of 
criteria for exponential stability. These are our main theoretical 
results. Finally, three numerical examples are given to show 
the correctness of our obtained results. 

In the end, we give some discussions about future directions 
of the complex-valued neural networks: 

1) This paper deals with complex-valued neural network 
by decomposing it to real and imaginary parts and 
constructing an equivalent real-valued system. To ensure 
this decomposition, we assume the partial derivatives of 
activation functions exist and bounded, see Definition 


[2] How to find an efficient way to analyze complex¬ 
valued system using the complex nature of system and 
consider its properties on complex planes will be our 
future direction. 

2) In this paper, we consider the asynchronous time delays, 
which can be regarded as discrete delays. However, a 
distribution of propagation delays can exist for neural 
networks due to the multitude of parallel pathways 
with a variety of axon sizes and lengths. Therefore, 
continuously distributed delays can be a good choice, 
so investigation of stability under distributed delays will 
also be our future direction. 

3) As for the dynamical behaviors of complex-valued 
neural networks, the global existence and exponential 
stability is just an aspect, there are also many other 
interesting dynamical behaviors for future research, for 
example, the multistability, the robustness of uncertain 
neural networks, the existence and stability of periodic 
(or almost periodic) solutions, chaotic behaviors for 
(delayed) complex-valued neural networks, etc. 


Appendix A: The proof of TheoremQ] 

Proof: Define 

Xj(t) = e et zf{t), y 3 it) = e et ij (f), j = 1,2, • ■ ■ , n. (24) 
Then we have 


Xj(t) = {~dj + e)xj(t) 


+ £■ 

k =1 


J jk 


\df« 

d.f h R } 

n 

I 

\df k 

dfl 1 

U-T 

dz k \ 

-2^ a jk 
k= 1 

4 

H Vk \ 


+ J2 b & eTjk 


k =1 


d 9k 


R 


-J2 b l 


Ok* 


k =1 


dz k(fjk) 

dal 


Xk(Tjk) 


7Xk{j jk ) 


dg£ 

dz lifjk) 

d 9k 


VkiTjk) 


VkiTjk) 


ldz«(T jk y^ dziiTjk y^\ 


(25) 


and 

y 3 (t) = (-dj + e)yj(t) 


£■ 

k=1 


J jk 


W Xh + M 

dzf k + dz{ 


Vk 


£<4 


fc=i 


3/4 , df k 


R 


dz* 


Xk + 


K 


iik 


£ b ? k e^ 


k =1 


dal 


+ £ 6 i 


jk c 


k =1 


dzkifjk) 

dg£ 


Xk (Tjk) 


Xk{Tj k ) 


dgl 


dz l(fJk) 

dg£ 


yk{zjk) 


VkiTjk) 


dzki T jk) — dzliTjk) —' 


(26) 


where df£/dz b k denotes df^iz^it),z{it))/dz b kl a,b = 
R,I; Xkjrjk) = Xk {t Tjk), and ykjTjk) = 

y k {t - Tjk)', while df^/dz b k {Tj k ) denotes 

dfkizktt ~ T ik), 40 - Tjk))/dz b k it - Tj k ), a,b = R, I. 

Let 


X(t) = (xi(£),••■ ,x„(£),yi(t),--- ,yn{t)) T S R 


2 nxl 
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so X(t) 


e et Z(t), and ||X(f)|| {C)0o} 


max{ma Xj {|^. x 3 (t) |},ma Xj {|^. y 3 {t )|}}. 

Case 1: For X(t), if jo = jo(t), which depends on t, is 
such an index that \£,~ k x 3o {t)\ = ||X(f)|| {?j0o} , then 


^II^MIIu.oo} _ d\x 30 (t)\ 


SJO 


dt 


dt 


=sign{x 3o (t)}^ jo (-d 3o + e)^. o 1 x jo (f) 

n p\ fR ^ ps -pR 




fc=l 


fc=l k 


/C=l “ k 

^ k b R U ' Jk -^«- 1 

k 


da? 




e £T3 '° fc 4 1 Xki.T jok ) 


da? 




-J2^ kb . 


I rffJk „eT inkC -l 
' jok dz R (r jok ) 


e £T ™ fc 4. X k ( T 3 ok) 


/C=l “ fc V JO 




<tjo(-djo + e + {afoio} +A fo fl + {-aU} + ^)Kio 1 *Jb(*)l 

n 

+ E a|af 0fe |A^.||X(f)|| {?iOo} 

k=l,k^j 0 


-\\x mu,c 


>} 


fc=i 


+ E ^Kfci^-n^wiitt.oo} 

k=l,k^j 0 


+ E^ fc l a lofcl X k ' II^WIIu.oo} 

fc=l 

n 

+ ^2t.k\b? ok \n? R ■ e eTj ° k \\X(t - r iofc )|| {Ci0o} 
fc=l 
n 

+ J2^ k Kok\a RI ■ e eTi ° k \\X(t — Tj 0 fc)|| { j iOo} 

fc=l 

n 

+ ^ik\ b ] 0 k\a{ R ■ e eTj ° k \\X{t - T 3ok )\\ {Loo} 
k= 1 
n 

+ E fcl^iK 1 • e er ™ fc ||X(f - T iofe )||{j,oo} 


fe=l 


H &0 ( - dfc + e + {«Ei +A r + {-°iojo} A . 


+ E ^l a fofel A fc fl + E^l a fofel A ; 

fc= 1, fc# Jo 


RI 

k 


k= 1 


fc=l,/c^jo 


k= 1 


E^ofcK + E ^fcl^nfcl^fc + E^M^ 

fc=l fc=l fc=l 

n -> 

+ E^l^ofcl/ fc / K T ^||X(f-T io fc)|| {?i0o} . 


/.R 

fc 


fc=l ' 

Furthermore, define 

M(t)= sup ||X(s)[| u>oo} , (27) 

t—T<S<t 

where r = ma x 3k Tj k - Then ||X(t)||{£ i0 o} < M(t), and if 
||^(t)||{C,oo} = M (t)’ we have 

tjo rf||X( ^ l{{,00} < Tl(jo) ■ M(t) < 0. (28) 

Case 2: For X{t), if jo = jb(t), which depends on t, is 
such an index that \^>~?yj' 0 (t)\ = ||2f(f)||{j jtx) }, then 

, d|l-y(*)ll{g,oo} _ d\y 3 ' 0 (t )| 


^ dt 


dt 


=sign{%'(f)}|^'(-^' +e)(t> fo y 3 ' 0 (t) 

p\ rj H p\ nj 

+ E& a ?jka4 Zk lxk + Y J <t> ka lk-£r<t>? 1 y k 

k =1 ^ ^ 

+E^ a E^E^ + E^ a E^-^ 1 2 /fc 

/c—1 k k— 1 k 

n p. j 

+ S & ‘ S *Sf^)*' r< ‘ CI *‘ ( 3l ) 

H 


+ ^ tb " k M^Y r, ‘‘^ vtiT zX 

Tl p\ R 

^ pi R ^ 

-{^0 ( - d t'o + 6 + {°^} + A # + 


+E^i a &i A * fl + E +E^i4 0 *i a : 

fe=l>fe#3n 


RR 
, n k\ / ^k 


k—1 


k =1 


+ E ^l^ fc l A f fll^COIkcoo} 


E^i^i^+E^ i 6 ^*^"+E&i 6 £fcitf 

fc=i fc=i 

1 1 

^e e ^o fe ||JC(t — -7-j'fe)||{ € ,oc}- 


k 


fe=1 


From the definition of ( ITTb . we have ||X(f)||{j i0 o} < M(t), 
and if ||X(f)|| {s>oo} = M(f), 

d||X( ^ l{g ’°° } < T2(j' 0 ) ■ M(t) < 0. (29) 

Therefore, for the above two cases, according to ( l28l > and 
, one can get that M(t) decreases monotonely, which 
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implies ||V(i)|+ i0o} = 0(1) and 

\\Z{t)\\ {Loo} =0{e-*% 

i.e., zf{t) = 0(e -et ) and zj(t) = 0(e~ et ),j = 1,2,--- ,n. 

Consequently, for any ti,t 2 € /?,tj > 0, there exists a 
constant O > 0, such that 

iiz(f 1 )-z(f 2 )ii {?>00} = n f 1 z(t)dt\\< f 1 wm\\dt 

Jt 2 Jt 2 

< [ 1 Oe- £t df = —{e~ et2 - e~ etl ) < -e~ et2 . 

Jt 2 e e 

By Cauchy convergence principle, we conclude that 
lim Z[t) = Z, for some Z = (Z 77 , Z 1 ) T . It is easy 

£->-+oo 

to get that Z is an equilibrium point of the systems © and 

©r 

Next, we prove that the equilibrium point is unique. Let Z 
be any equilibrium point of the systems © and ©. By the 
same arguments, we can prove that 

||Z(i)-Z|+ i00} = || / Z(t)dt\\ < —e~ £t . 

Jt e 

which means that any solution Z(t) converges to Z exponen¬ 
tially and the equilibrium point is unique. ■ 

Appendix B: Proof of Theorem[2] 

Proof: Recall the definition of Xj (t) and yj (t) defined in 
Gil. we can define a Lyapunov function as 


Appendix C: Proof of Theorem^] 

Proof: Recall the definition of Xj(t) and yj(t) defined in 
Gl- we can define a Lyapunov function as 

n n 

L 2{t) = Y £jx 2 j(t) + Y fay*® 

j =i i=i 

n pt 

+ Y a 'jk e2eTjk / x 2 k (s)ds 

j,k= 1 Jt—Tjk 

n pt 

+ Y P'jke 2tTik / yl(s)ds, 

j,k=l Jt-Tjk 

where 

n 

a 'jk = y^Aj(\^fk\^k R + IbjklV'k^KSjk 

k =1 

n 

+ foififklVk 11 + l^klVk^uSjk', 

k= 1 
n 

&jk = y^Aj(\b?k\i j 'k i + 

k =1 

n 

+ Y^ + Wjkldk / ) w 4 J -fc 1 . 

fc=1 

Differentiating L 2 (f) along equations Gl and G6l . using 
some calculations (the details are left to interested readers), 
one can get that 

n n 

l 2 (t) < 5>i3(j+ 2 (i) + Y TU ti)y 2 (t) < o- 

1=1 1=1 

By similar arguments used in the proof of Theorem [T] it is 
easy to see that the equilibrium point is unique. ■ 


L i(t) + Y < t ) o\vA t )\ 

l=i l=i 

n pt 

+ a jke eTjk / |x fe (s)|ds 

i,k—l dt—Tjk 


Y fo* eeTjk 

j,k= 1 


|2/fc(s)|ds 


where 

«ifc = ZAKk\p% R + \^M R ) + 

Pjk = ZjQbfklPk 1 + \bjk\dl 1 ) + <l > j(\bfk\P'k I + \bjk\dk 1 )- 

Differentiating L\{t) along equations Gl and Gl . using 
some calculations (the details are left to interested readers), 
we have 


Li(t) < Y T7(k) ■ Mi)| + ^ T8(k) ■ \y k (t)\ < 0. 

k—l k -1 

By similar arguments used in the proof of Theorem [I] it is 
easy to see that the equilibrium point is unique. ■ 
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